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WJhdsr  control  of  a  heuristic  program,  a  flyiner-spot  acanasc  is  used  to 
digitize  selected  portions  of  a  panoramic  dental  radiograph.  These  digitise 
signals  are  filtered  mathematically  and  the  resulting  smoothed  and  enhanced 
signals  are  analyzed  by  feature  recognition  program.  The  outlines  of  eadst 
teeth  are  than  recreated  by  the  oanfwber  end  displayed  on  a  graphic  display 
terminal. 
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The  purpoee  of  this  investigation  was  to  develop  a  working  nodal  of 
a  ocnputariaert  picture- scanner/ijnag&-prpoagaing  system  to  evaluate  panr«gj«<^ 
dental  radiographs.  A  flying-spot  scanner  controlled  by  a  heuristic  ooeputer 
program  digitised,  select  regions  of  the  radiograph  and  the  resulting  signals 
were  stored  in  an  EEM  1130  ccnputer.  appropriate  mthamatical  filtering 
techniques  ware  applied  to  these  signals,  and  the  resulting  enhanced  signals 
were  then  analysed  by  feature  recognition  programs  which  then  reconstructed 
the  images  of  existing  teeth  and  displayed  them  on  a  graphic  display  terminal. 

Although  the  panoramic  radiographs  contain  a  considerable  amount  of 
noise  generated  by  the  blurring-out  of  structures  not  in  the  plane-of-focus 
of  the  x-ray  imaging  system,  and  non-linearities  in  the  intensity  of  the 
modulated  x-ray  beam  effecting  the  film,  it  was  possible  to  separate  the 
information  content  from  the  noise  with  a  moderate  degree  of  reliability. 

Another  interesting  aspect  of  this  project  wee  the  use  of  the  radiograph 
itself  as  the  storage  meditm  far  the  image.  Only  small,  prs  detanninad 
areas  of  the  film  were  scanned  and  stored  in  the  oonputar  at  any  given  time. 
This  permitted  the  system  to  operate  with  a  relatively  email  ccnputer  system 
(16  K  memory)  and  one  disc-pak. 

Citation  of  trade  names  in  this  report  does  not  constitute  an  official 
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I.  Project  Overview 

Panoramic  dental  radiographs  display  the  entire  dental  apparatus  (the 
teeth  and  their  supporting  and  surrounding  structures)  on  one  continuous 
5"  x  12"  film. 

The  objective  of  this  projact  was  to  develop  a  working  model  of  a 
ocnputerized  picture-scanner/image-prooessing  system  fear  obtaining  information 
relative  to  the  dental  status  of  a  person  using  a  panoramic  dental  radiograph 
as  the  source  document. 

The  information,  in  machine  readable  form,  aould  then  be  used  to  build 
a  data-base  of  standardized  "dental  profiles"  that  could  be  used  to: 

a)  maintain  a  chronological  dental  history  for  a  given  patient; 

b)  check  for  pre-existing  conditions  at  a  certain  point  in 
time  for  insurance  purposes,  eligibility  for  dental  care 
by  certain  agencies  such  as  the  VA? 

c)  provide  a  file  for  possible  identification  of  disaster  victims 
based  on  infbrwticn  of  existing  dental  conditions  (restorations, 
missing  teeth,  prosthesis,  etc)  of  the  victim (s)  ? 

d)  perform  epidemiological  dental  health  surveys  for  various 
sub-populations  of  the  data-base  over  time;  etc. 

This  system  would  include: 

a)  a  scanner  far  digitising  the  image  of  a  dental  panoramic 
radiograph; 

b)  a  coBOutesr  to  control  the  scanner,  process  the  digitised  picture 
information,  operate  devices  used  to  monitor  operation  of  the 
scanner  and  display  the  results  of  the  picture  processing  procettees; 


c)  an  interface  between  tha  acannar  and  conputar  for  the 
tranenissicn  of  digital  information  firm  tha  nrwpnww  to  tha 
scanner  (DA  conversion)  and  transmission  of  picture  infbansticn 
front  the  scanner  to  the  ocepuber  (A/D  conversion) ; 

d)  appropriate  display  devices  to  provide  visual  displays  and 
hard  copy  of  the  imaqe  processing  results;  and 

e)  the  necessary  computer  propane  to  drive  and  control  the  scanner, 
process  the  picture  information  and  control  the  various 
display  devices. 

There  were  three  major  developmental  oonpanents  in  the  project: 

1*  Hardware  Development 

design  and  develop  the  optical  scanning  equipment; 

-  select  a  suitable  oonputar  system  to  drive  the  scanner  and 
process  the  picture  Information;  and 

-  design  and  construct  the  interface  required  to  link  the 

scanner  to  the  computer,  including  the  necessary  A/D  (analog-to~digital) 
end  DA  (digital-to-anelog)  converters. 

2.  Software  Development 

-  develop  the  aceputer  pr  _  '■to: 

e)  trerwedt  infomeetlan  between  the  sesmsr  and 
aceputer; 

b)  drive  the  scanner,  including  control  of  the 
scanning  CBS  and  aaaauriant  of  the  dansity; 


c)  process  the  digitised  picture  information;  and 


d)  control  and  c&ar ate  the  various  display  deviaes. 

A  description  of  each  of  these  major  project  ocnpcnanta  is  presented  in 


following  sections  of  this  report. 

3.  Picture  Processing  Algorithms  Development 

-  evaluate  the  information  content  of  the  panoramic  dental 
radiographs  produced  by  the  Panorex  Dental  X-Ray  machine,  and 
design  the  image  processing  heuristics  for  collecting  and  eval¬ 
uating  picture  information  from  the  radiograph. 


n 


The  theoretical  basis  of  picture,  or  image,  processing  is  the  ability 
to  reproeont  a  picture  (or  radiograph)  as  a  mathematical  function,  f  (x,y) , 
of  the  optical  density  of  the  picture  at  coordinate  point  (x,y)  in  the 
spatial  domain,  or  alternatively,  as  a  function  of  frequenciaa  and  anplitudes, 
F  (u,v) ,  in  the  frequency  domain.  The  specific  mathematical  technique  used 
to  transform  the  picture  function  from  one  domain  to  the  other  is  the  Ftourier 
transform  (and  its  inverse). 

In  general,  objects  or  areas  are  recognized  in  a  radiograph  by  first 
detecting  the  boundary  delineating  the  area,  and  then  applying  some  type  of 
classification  process  to  the  shape  or  general  density  level  of  the  delineated 
area  to  identify  the  object. 

There  are  two  basic  attributes  that  are  used  to  describe  the  visual 
appearance  of  a  "boundary"  in  a  radiograph: 

a)  contrast,  and 

b)  detail 


Essentially,  radiographic  contrast  is  the  amount  of  density  difference 
between  adjacent  areas  in  a  radiograph.  Radiographic  contrast  is  said  to  be 
"high”  when  there  are  only  a  few  recognizable  density  levels  between  the  blade 
and  clear  areas  in  a  radiograph;  this  is  often  referred  to  as  "short-scale" 
contrast.  Khan  peony  different  density  levels  can  be  recognised,  the  radiograph 
is  said  to  have  "low"  radiographic,  or  "long- scale"  contrast. 

Figure  la  illustrates  the  density  plot  across  a  boundary  on  a  radiograph 
with  high  radiographic  contrast.  Rota  the  marked  difference  between  regions 
A  and  B.  Ohs  plot  of  tbs  dungs  in  density  across  a  boundary  with  lot 
radiographic  contrast  is  dapictad  in  Figure  lb;  note  the  relatively  anil 
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The  Illustration  on  the  loft  depicts  the  "radiooraphic  ffwcano"  and  <tansity 
plot  of  a  high-contrast  radiograph  of  the  stop  i#edge  shorn  above;  the  illustrat: 
on  the  right  oorreeponde  to  a  low  contrast  situation. 


difteonoe  in  densities  between  regions  A  and  B  in  the  plot.  It  Is  iapoctent 
to  not*  that  in  order  for  the  human  eye-brain  system  to  reoognizs  a  boundary 
in  a  radiograph,  the  difference  in  daneitiee  between  the  regions  on  either 
side  of  the  boundary  must  be  greater  than  a  certain  critical  value. 

Fran  an  image-processing  poinfc-of-view,  image  contrast  is  a  significant 
factor  in  the  picture  representation  and  interpretation  in  the  spatial 
domain,  and  critical  density  differences  must  also  be  defined  for  the 
ootpubar  to  "recognise1*  the  existence  of  a  boundary. 

The  abruptness  of  change  in  density  between  two  discernible  areas  in  a 
radiograph  is  referred  to  as  radiographic  detail. 

Density  plots  across  a  radiograph  boundary  with  good  and  poor  detail 
are  illustrated  in  Figures  2a  and  2b,  respectively. 

In  general,  radiographic  contrast  and  detail  are  subjective  terms. 

The  mathematical  concept  of  a  gradient  carbines  these  two  concepts  into 
a  single  quantitative  measure  by  taking  into  consideration  the  rata-af-change 
of  density  in  a  given  direction  over  a  given  distance  in  the  picture  or 
radiograph.  In  oarputerized  picture  processing,  it  is  the  magnitude  of  the 
gradient  in  a  given  area  of  the  picture  that  is  ultimately  used  to  identify 
boundariee. 

It  ia  known  that  sharply  defined  boundaries  in  the  spatial  domain 
are  associated  with  high-frequency  ccnponants  in  the  frequency  domain;  fuzzy 
or  soft  boundaries  have  a  significant  lew  frequency  axpenent.  By  removing 
the  law  frequency  component  (s)  from  the  frequency  domain  representation  of 


a  picture  by  the  use  of  a  "high-pass  filter" ,  and  using  the  inverse  Fourier 
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The  illustration  on  thi  loft  carrmpcnUm 
with  good  detail  -  note  the  abrut  change 
thick  and  thin  portions  of  the  step  wedg 
oorreeponds  to  a  radiooraph  with  the  earn 
note  the  relatively  wide  transition  sons 
thick  and  thin  parts  of  the  stap  wedge. 


to  a  radiograph  of  given  contrast 
of  density  between  the  image  of  the 
i.  The  illustration  on  the  right 
i  contrast,  but  with  poor  detail  - 
between  the  areas  representing  the 
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to  be  sharper  in  the  sense  that  density  changes  corresponding  to  boundaries 
would  appear  more  abrupt  over  a  given  distance  (i.e.  for  a  given  region  of  the 
picture,  the  density  gradient  would  be  greater  after  this  filtering  or  enhance¬ 
ment  operation  was  applied) . 

Fran  this  brief  discussion,  it  is  apparent  that  the  visual  detection 
and  recognition  of  a  boundary  in  a  radiograph  depends  on  two  factors : 

1.  that  there  be  a  minimal  absolute  difference  between 
the  densities  in  the  region  on  either  side  of  the 
boundary  -  that  is,  there  must  be  sufficient  contrast 
between  the  regions;  and 

2.  that  this  density  change  occur  over  a  very  snail  distance 
so  that  the  boundary  is  sufficiently  "sharp"  -  that  is, 
the  radiograph  must  possess  sufficient  detail. 

The  recognition  of  boundaries  in  an  image  processing  system  is  also  based 
on  the  detection  of  a  gradient  of  suitable  magnitude.  The  ccnputerized 
system  has  the  advantage,  however,  of  being  able  to  "mathematically  enhance” 
the  image  by  suitable  filtering  techniques  before  applying  boundary  recognition 
criteria. 


Vhile  objects  themselves  nay  hove  sharp,  well-defined  physical 
boundaries,  the  radiographic  images  of  these  boundaries  never  appear  as 
sharp  or  as  well-defined.  This  degradation  of  bouadary  detail  is  an  inherent 
feature  of  all  x-ray  imaging  system  and  is  due  to  such  factors  as: 

finite  focal  spot  size,  rather  than  a  pin-point  source; 
scatter  of  the  x-rays  by  the  object  itself; 
secondary  radiation; 

-  quantum  effect  of  intensifying  screens; 

-  film  grain  size; 

movement  of  object  and/or  x-ray  tube  during  the  exposure. 

'Die  Panorex  Dental  X-ray  machine  was  used  for  this  project  as  it 
produces  a  display  of  each  half  of  the  head  on  a  well  defined  5"  x  5”  area 
of  the  5"  x  12"  panoramic  dental  film.  See  Figure  3.  The  design  of  this 
machine  is  based  cm  the  principal  of  curved-surface  tonography . 

Conventional  x-ray  imaging  techniques  produce  a  radiograph  of  an  object 
in  which  all  the  structures  in  the  path  of  the  x-ray  beam  are  super-imposed 
upon  one  another  in  the  resulting  radiograph. 

Tomography  is  an  imaging  technique  that  can  produce  a  relatively  sharp 
image  of  a  layer  within  an  abject,  with  the  images  of  the  structures  above  and 
below  the  layer  of  interest  blurred  out.  The  degree  of  blurring  of  these 
structures  outside  the  desired  layer  is  dependent  on  the  distance  these  other 
structures  are  above  or  below  the  layer  of  interest  -  the  further  they  axe 
removed,  the  greater  the  blurring  effect.  The  tomographic  technique  virtually 
eliminates  the  effect  of  super-position  of  structures  above  and  below  the  layer 
of  interest. 


Ponorex  unit  and  an  example  of  the  panoramic  radiograph  made  with  this  unit. 
The  x-ray  tube  and  the  casette  holder  revolve  around  the  patient's  head.  A  thin  beam 
of  x-rays  emerges  from  the  tube  head,  passes  through  the  patient,  and  then  enters  the 
slit  opening  shown  in  the  cassette  holder.  The  cassette  in  the  cassette  holder  moves  be¬ 
hind  the  slit  at  the  same  speed  as  the  jaw  is  scanned  by  the  x-ray  beam.  (Courtesy  X-Ray 
Manufacturing  Corporation  of  America,  Great  Neck,  N.  Y.) 


The  net  effect  is  to  profane  an  x-ray  iaage  of  a  desired  layer  in  an 
object  that  portrays  the  structures  in  the  layer  of  interest  with  greater 
clarity  and  visualbility  than  could  be  produced  by  a  conventional  stationary 
technique. 

Mechanically,  the  x-ray  tube  and  film  carrier  of  the  Panorex  machine 

axe  connected  to  each  other,  and  designed  to  rotate  about  a  rotation-canter 

in  the  object.  The  x-ray  beam  is  collimated  into  a  narrow  beam,  or  sheet, 

with  a  rectangular  crose-aection.  The  film  carrier  has  a  slit  that  corresponds 

to  the  shape  of  the  collimated  x-ray  beam,  so  that  only  a  portion  of  the  film 

the  seme  size  as  the  beam  is  exposed  at  any  given  time.  As  the  tube  and  film 

carrier  rotate  about  the  rotaticn-osnter  in  the  object,  the  film  is  transported 

across  the  slit  in  the  film  carrier  at  a  rate  such  that  the  image  of  the  teeth 

appears  "sharp",  while  the  structures  on  either  side  of  the  teeth  are  blurred 

out  due  to  their  apparent  motion  relative  to  the  film. 

« 

Ftar  a  fixed  film  speed,  the  thickness  of  the  layer  that  appears  sharp, 

(i.e  the  "focal  trough")  varies  with  the  angle  of  movement  of  the  x-ray  beam 
relative  to  the  object.  If  the  x-ray  bean  moves  through  a  large  angle,  the 
trough  is  narrow;  if  the  angle  is  small,  the  band  of  acceptable  focus  is  wide. 

For  the  Panorex  machine,  the  focal  trough  is  about  1/2"  to  2/3"  wide. 

The  rotation-center  is  just  lingual  to  the  third  molars  on  the  side 
of  the  head  opposite  to  tha  aids  that  is  being  imaged.  Mid-May  through  the 
exposure,  the  oanter-of-rotation  is  physically  relocated  to  the  apposite  side 
of  the  patient's  head  to  permit  imaging  of  tha  other  side.  This  is  accomplished  by 
physically  moving  the  patient  tha  required  distance  relative  to  the  x-ray 


tube/film  carrier  ocaponant.  During  this  shift  of  rotation-embers,  tbs 
x-ray  baan  is  cut-off,  but  tbs  tube-head  and  film-carrier  continue  bo 
rotate  about  the  object.  See  Figure  4. 

The  x-ray  beam  is  again  turned  cn  when  the  trbe-haad/fUn-oarrier  has 
been  positioned  over  the  new  rotation-canter,  ibis  shut-down  of  the  beam 
results  in  a  clear  band  being  produced  in  the  middle  of  the  film  and  the 
images  of  the  teeth  immediately  adjacent  to  t be  mid-line  appear  in  both  halves 
of  the  radiograph. 

The  radiographic  detail  of  films  produced  by  the  Panorex  system  is  somewhat 
less  than  that  of  conventional  x-ray  imaging  systems.  The  two  major 
factors  responsible  for  Ibis  image  degradation  axe: 

1.  movement  of  the  x-ray  source,  film  or  object  relative  to 

one  another:  this  results  in  a  decrease  in  the  sharpness  of  the 
resulting  image;  even  though  all  of  these  ocnpcnents  are 
suppose  to  be  at  relative  zest  to  one  another,  there  is  still 
a  very  email,  but  limited  amount  of  motion  between  the  abject  and 
the  film  which  results  in  a  slight  fuzziness  in  the  radiograph; 
and 

2.  the  use  of  a  film  cassette  and  intensifying  screen  to  reduce 

the  total  amount  of  radiation  required  to  produce  the  radiograph: 
the  screens  introduce  seme  level  of  quantum-noise  that  also  has 
a  slight  (but  unavoidable)  negative  effect  on  image  detail. 

There  are  several  other  factors  that  also  effect  the  dmnaity  of  the  radiograph 
produced  by  the  Panorex  machine.  Since  the  exposure  time  and  target-film  distance 
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an  find  in  the  Panocex  system,  their  effect  an  the  radiographic  dmity 
of  the  reeulting  radiograph  is  a  constant.  Assuming  peeper  film  processing 
procedures,  the  variable  factors  which  affect  the  image  density  are: 

Factor  Effect  on  Density 

Jcilovoltage  increases  with  Kvp 

millianperage  increases  with  net. 

film  incxeasee  with  film  speed 

screen  increases  with  speed 

object  size  increases  with  thickness 

It  is  inportant  to  note  that  while  the  film  and  screen  may  be  standarised 


far  all  subjects,  and  the  ma  set  at  a  fixed  value  far  all  exposures,  the 
Kvp  is  a  function  of  the  physical  size  of  the  subject's  head,  individual 
variation  in  bene  structure,  bene  density,  etc.  are  not  quantitatively 
considered  when  setting  the  Kvp.  This  results  in  a  considerable  variation 
in  the  over-all  density  level  between  radiographs  of  different  subjects. 

While  there  is  a  specific  manner  in  which  the  head  is  positioned 
relative  to  the  rotatienroentero  of  the  machine,  the  qpward/downwaxd 
tilt  of  the  head  is  only  approximate  (it  is  based  on  a  5-degree  downward 
inclination  of  the  ala-tragus  line) .  This  results  in  considerable  variation 
in  the  shape  of  the  dental  archaa  in  the  resulting  radiograph  (specifically, 
the  degree  of  convexity  of  the  arches) ,  and  also  in  the  position  of  the  images 
of  other  structures  of  the  skull  bones  relative  to  the  images  of  the  teeth* 


(b) 


Figure  4 

Principle  of  operation  of  tho  Panorax  Dental  X-ray  aachina.  (a)  Halation  ship 
of  tha  tuba  haad  (A)  and  flla  transport  aachanisa  (B)  to  tha  patiant. 

(b)  Halation ship  of  oaatars  of  rotation  and  focal  trough  to  patiant' a  jaw, 
as  saaa  fron  above. 
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Thus,  while  all  penormnic  radiographs  contain  ths  sans  basic  information, 
they  aza  subject  to  considerable  variatiai  with  raspact  to  over-all  density, 
contrast  and  detail,  shape  of  the  dental  arches,  and  "noise"  due  to  the  images 
of  other  structures  of  the  skull  interfering  with  the  images  of  the  teeth. 

There  is  also  a  certain  degree  of  magnification  in  the  resulting 
radiographs  that  is  not  constant  over  all  parts  of  the  image,  ffiile  this 
variability  is  no  problem  for  the  visual  reading  of  these  radiographs,  it  does 
present  significant  problems  for  a  ccnputer-b&sed  image  processing  system. 


Che  approach  to  picture  processing  is  to  digitize  the  entire  picture 
and  have  it  core-resident  in  Idle  ocnputer  during  processing.  Considering 
the  nature  of  the  information  that  is  to  be  extracted  from  the  radiograph, 
the  sanpling  rate  could  not  be  less  than  200/inch.  Therefore,  for  a  5"  x  5" 
radiograph,  1,000,000  data  points  would  have  to  be  stored?  and  if  a  higher 
sanpling  rata  were  required  to  detect  significant  density  variations,  this 
nunher  would  be  even  larger 

The  approach  adapted  far  this  project  was  to  use  the  panoramic  radiograph 
itself  as  a  "random  access  storage  median".  This  was  aaxnplished  by  designing 
a  flying-spot  scanner  with  no  inherent  raster-generating  capability,  but  rather 
with  the  ability  to  position  the  spot  at  an  (x,y)  coordinate  supplied  by  a 
ocnputer,  and  then  return  the  density  at  that  point  back  to  the  computer.  Hus, 
picture-image  information  of  a  small  section  of  interest  of  the  total  radiograph 
only  need  be  in  the  computer  memory  at  ary  given  time.  This  concept  greatly 
reduced  the  size  of  the  ocnputer  memory  required. 

Baaed  on  this  concept,  the  EOCT  scanning  system  was  designed  and  fabricated 
with  the  following  components; 

1.  a  flying-spot  optical  scanner; 

2.  an  IBM  1130  computer; 

3.  display  devices. 

See  Figure  5. 


SCANNER 


The  scanner  is  a  flying-spot  design  using  a  Litton  industries 
Micropix  Ultra-High  Definition  CRT  (Model  Mo.  L-4123)  with  a  P-16 
phosphor.  Magnetic  focusing  and  deflection  is  used,  and  the  CRT 
is  housed  in  a  Litton  Model  1031  Magnetic  Shield  to  minimize  the 
effect  of  stray  magnetic  fields  from  affecting  the  spot  size  and 
position. 

The  anount  of  deflection  of  the  spot  is  dependent  an  the 
analog  signal  resulting  fran  the  DA  conversion  of  the  x  and  y 
coordinates  transmitted  to  the  scanner  from  the  computer.  The 
scanning  matrix  is  2048  x  2048  points  over  a  5"  x  5"  area,  and  the 
spot  size  was  less  than  5Cta  on  the  CRT  face  plate.  The  x  and  y 
scan  axes  were  orthogonal  to  within  +  5  degrees;  beam  positioning 
time  is  less  than  10  microseconds.  See  Figure  6. 

The  system  uses  two  HCA-4517  10-stage  photomultiplier  tubes  to 
convert  the  light  beam  from  the  scanning  CRT  to  a  signal  proportional 
to  the  density  of  the  radiograph  at  a  given  scan  point.  After  passing 
through  the  film,  the  transmitted  light  beam  is  split  by  a  half- 
silvered  mirror  so  that  50%  of  the  transmitted  light  goes  bo  a 
reference  photomultiplier,  and  50%  of  the  light  goee  bo  a 
measurement  photomultiplier.  See  Figures  7  and  8. 

The  output  signal  is  the  ratio  of  the  outputs  of  the  1*o 
photomultipliers;  this  technique  has  the  advantage  of  eliminating 
the  effects  of  variation  in  OCT  spot  intensity  due  bo  fluctuations 
in  line  voltage,  etc. 


nta  scanning  CRT  subsystem 


SUB  SYSTEM  TWO 
AND  CATHODE  RAY  TUBE 
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Timing  circuit*  control  the  integration  time  of  the 
photomultipliers,  and  at  the  end  of  the  integration  period,  the 
PMT  output  signal  is  fed  to  an  A/D  converter,  here  it  is  converted 
to  a  digital  signal  corresponding  to  the  density.  Density  returns 
are  digitized  to  64  levels,  corresponding  to  an  absolute  density 
of  0  to  2.05.  See  Figure  9. 

All  necessary  power  supplies,  timing  circuits  and  related 
electronics  were  housed  in  one  cabinet,  and  the  CRT  and  IMF's  were 
built  into  a  second  cabinet. 

The  computer  used,  was  an  IEM  1130  with  16K  core  memory,  one 
disk,  and  a  line  printer. 

There  were  several  display  devices  incorporated  into  the  system 
that  permitted  real-time  visualization  of  the  scanning  process,  and 
selective  output  of  either  the  scanning  process  or  the  results 
of  processed  information. 

iter  real-time  monitoring  of  the  scan  process,  a  Tektronix 
Type  602  Display  Unit  with  a  5"  CRT  with  a  moderately  long- 
persistence  phosphor  was  selected.  This  device  was  incorporated 
into  the  scanner  hardware  and  provided  a  direct  visualization  of  the 
movement  of  the  spot  of  the  scanning  CRT.  A  Tektronix  Type  C-30A 
camera  with  Polaroid  Land  roll-film  camera-back  was  provided  to  take 
pictures  directly  from  the  face  of  the  602  unit. 

A  Tektronix  611  Storage  Scope  with  a  2311  hard  aopy  wit  was 
available  to  display  (and  hold)  graphic  output  from  the 
ccnputer,  and  the  1130  line  printer  was  available  for  text  printing. 
See  Figures  10  and  11. 


-  23  - 


Figure  10 

The  DXCP  system  hardware.  From  left  to  right:  the  tall  cabinet  on  the  left 
houses  the  scanning  CRT1  and  the  photomultiplier  tubes:  the  other  tall  cabinet 
contains  the  power  supplies  and  control  circuits;  the  boxes  on  top  of  these 
cabinets  contain  the  computer  interface  components;  next  is  the  Tektronic  611 
storage  scope  and  the  2311  hard  copy  unit;  the  IBM  1130  computer  is  on  the  right. 
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B.  Data  Acquisition 

An  analysis  of  the  information  content  of  the  panoramic  radiograph 
produced  by  a  Panarex  Dental  X-ray  machine  revealed  the  following  conditions 
that  had  to  be  taken  into  consideration  and  utilized  in  the  development 
of  the  data  acquisition  algorithm: 

1.  the  linages  of  the  teeth  occupy  only  about  25%  of  the  panoramic 
radiograph; 

2.  there  is  considerable  variation  in  the  general  appearance 
of  the  image  of  the  dental  arches  in  the  panoramic 
radiograph,  both  with  respect  to  their  position  on  the 
film  and  the  relative  position  of  adjacent  boney  structures 
of  the  skull; 

3.  the  resulting  image  of  the  incisal  and  occlusal  surfaces  are 
sensitive  to  head  position  during  the  exposure,  so  that  the  dental 
arches  could  appear  either  convex,  flat  or  concave  depending 

on  the  inclination  of  the  occlusal  plane  during  the  exposure; 

4.  there  is  considerable  variation  in  the  overall  density  of 
radiographs  of  different  people  due  to  individual  variation 
in  head  size,  and  bone  density  and  structure;  and 

5.  images  of  similar  structures  (i.e.  dentin)  in  the  seme  radiograph 
hove  different  absolute  densities,  so  that  there  is  no  way  of 
establishing  an  absolute  density  mapping  that  would  be  applicable 
to  all  areas  in  a  given  radiograph; 
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6.  the  inter-arch  apace  wee  always  darker  (l.e.  wee  of  greater 
optical  density)  than  the  bordering  teeth  or  edentulous 
areas; 

7.  the  boundaries  between  the  occlusal/incisal  surfaces  of  the 
teeth  and  the  anterior  border  of  the  ranus  of  the  mandible, 
and  the  inter-arch  space  were  almost  always  characterized  as 
"high  contrast"  boundaries  relative  to  other  boundaries  in  a 
given  radiograph; 

8.  the  image  of  the  mesio- incisal  angle  of  the  upper  and  lower 
central  incisor  teeth  always  appeared  in  a  finite  bounded  region 
of  the  radiograph,  about  1"  square; 

9.  the  shape  of  the  tooth  images  are  such  that  the  root  boundaries 
axe  approximately  at  right  angles  to  the  ooclusal/incisal  edges; 

10.  the  images  of  the  not  portions  of  the  teeth  were  approximately 
rectangular  in  shape,  with  the  long-axis  of  the  rectangle 
perpendicular  to  the  ooclusal/indsal  surface. 

Based  on  these  observations,  the  following  procedure  was  developed  to: 
a)  automatically  direct  the  system  to  a  readily  identifiable  starting  point 
in  the  radiograph;  b)  direct  the  scanner  to  gather  sufficient  information 
to  define  the  occlusal  and  incisal  boundaries  of  the  upper  and  lower  teeth, 
or  the  ridge  boundary  in  the  case  of  missing  teeth;  and  c)  direct  the  scanner 
to  gather  sufficient  information  to  define  and  identify  the  root  boundaries 
of  existing  teeth. 
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The  procedure  consisted  of  two  parts:  a)  a  technique  far  recording 
a  fiducial  nark  in  the  radiograph  in  a  specified  position  relative  to 
the  teeth;  and  b)  a  heuristic  oanputer  program  to  direct  the  scanner  to 
sanple  the  density  of  the  radiograph  in  a  specified  manner. 

Fiducial  Mark  Pp^^ng: 

1.  At  the  tine  the  radiograph  is  taken,  a  plastic  bite-blodc 
(about  5/16”  thick)  with  a  small  piece  of  wire  embedded  in 
it  was  inserted  in  the  subject* 1 2  s  mouth  and  oriented  so  that 
the  long-axis  of  the  wire-insert  was  parallel  to  the  long-axis 
of  the  teeth  and  located  at  the  mid-line  of  the  dental  arches; 
this  technique  provided  a  means  of  readily  identifying  the  mid- line 
of  the  dental  arches  cn  the  radiograph,  and  insured  the  separation 
of  the  upper  and  lower  teeth  and  the  existence  of  an  "inter-arch” 
space  in  the  resulting  radiograph.  See  Figure  12. 

Processing  Algorithm: 

1.  The  first  step  in  the  processing  algorithm  consists  of  a 
sequence  of  horizontal  scans  in  the  bounded  region  in  which 
the  radiographic  image  of  the  bibe-block  wire  is  expected;  this 
scan  continues  until  the  image  of  the  wire  is  detected  and 
verified  based  on  size  and  shape  parameters.  See  Figure  13. 

2.  Using  the  mid-point  of  the  wire  as  a  starting  point,  a  horizontal 
scan  is  initiated  extending  distally  from  the  wire  until  the 
boundary  between  the  inter-arch  space  or  lower  (tpper  tooth  is 
detected;  fran  this  intersection  point  a  vertical  scan  is 
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(a) 


(b) 


Figure  12 

Raster  scan  (a)  and  iso-density  curve  display 
(b)  of  panoramic  dental  radiograph  with  fiducial 
wire  mark  at  mid-line  of  dental  arches. 
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initiated  until  the  boundary  between  the  inter-arch  apace 
and  an  upper  (lower)  tooth  is  encountered. 

Using  the  mid-point  of  -the  line  joining  this  pair  of  upper  and 
lower  boundary  points  as  a  starting  point,  step  (2)  is 
repeated;  this  "stair-case"  procedure  is  repeated  until  the 
anterior  border  of  the  ramus  of  the  mandible  is  detected.  See 
Figure  13. 

A  second-order  least  square  curve  is  fitted  to  the  set  of 
upper,  and  the  set  of  the  lower  arch  boundary  points,  acpcoodmately 
the  occlusal-incisal  surfaces  of  the  teeth;  these  curves  are  used 
to  define  the  trajectories  for  the  root-scans  of  the  respective 
arches.  See  Figure  14. 

Motet  If  the  head  position  was  such  that  the  image  of  the 
arches  were  flat,  rather  than  concave,  the  anterior 
border  of  ramus  would  be  intercepted  an  the  first  search 
scan  from  the  mid-line  wire  in  this  case,  the  occlusal- 
incisal  surface  could  be  approximated  by  the  straight 
line. 

Starting  at  the  center  of  the  mid-point  of  the  wire,  a 
line  is  defined  parallel  to  the  long  axis  of  the  wire-this 
line  marks  the  mesial  extent  for  the  root  scans;  again, 
starting  at  the  center  of  the  wire,  a  distance  d  is  marked 
off  along  this  line  in  an  upper  and  lower  direction  -  using 
these  points  as  starting  positions,  and  following  a  trajectory 
as  defined  in  step  (4) ,  data  is  collected  at  a  specified 
sanpiing  frequency  and  stored  in  the  computer;  the  starting 


Ocrputer-guided  search  for  the  fiducial  irark,  and  the 
"stair-case"  scan  to  define  a  set  of  points  on  the 
boundary  between  the  inter-arch  space  and  the  upper 
and  lower  teeth. 


Least-square  curves  determined  by  the 
set  of  points  defined  by  the  "stair¬ 
case"  scan  procedure  supei^-irposed  on 
the  scan  trajectories  of  the  fiducial 
mark  search  and  the  stair-case  scan. 


-  33 


point  is  then  moved  apically  frcm  the  previous  position  by 
a  specified  amount  and  this  root-seam  prooess  is  repeated  until 
ten  such  root  scans  have  been  ccupleted.  See  Figure  15. 

6.  Starting  at  the  mid- line  wire,  and  extending  distally,  a  series 
of  up  and  down  scans  are  performed  to  define  the  boundaries 
between  the  interarch  space  and  the  occlusion-incisal  edges  of 
the  upper  and  lower  arches.  See  Figure  16. 

At  this  point,  eleven  data  vectors  are  stored  in  the  ocnpuber  for  each 
arch:  ten  root  scan  vectors  and  one  occlusal-incisal  edge  vector.  The  set 
of  vectors  for  each  arch  contains  approximately  4000  data  points  and  contains 
sufficient  information  to  define  the  outlines  of  the  teeth  in  each  arch,  if 
they  are  present.  This  technique  represents  a  marked  reduction  in  stored 
data  points  as  oanpared  to  storing  the  digitized  image  of  the  entire 
radiograph  (i.e.  about  4000  vs  1,000,000  data  points).  See  Figure  17. 

C.  Information  Processing 

As  stated  in  Section  II,  Mathematical  Concept  of  Picture  Processing,  a 
picture  can  be  described  in  terms  of  the  density  at  every  point  in  the  picture 
in  the  spatial  domain,  or  in  terms  of  frequency  and  amplitude  in  the  frequency 
domain.  Sharp  boundaries  were  also  defined  as  consisting  of  essentially  high- 
frequency  components  and  the  inclusion  of  low-frequency  ocnponents  tendency  to 
make  the  boundary  fuzzy  and  less  distinct.  A  picture  with  "soft"  boundaries 
oould  be  enhanced  by  filtering  out  the  low- frequency  ocnponents  by  a  suitable 
high-frequency  filter,  and  when  transformed  back  into  the  spatial  domain  the 
picture  would  appear  "sharper". 


The  ten  root  scan  trajectories, 
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Tire  scan  to  determine  the  actual  boundaries 
between  the  inter-arch  space  and  the  occlusal/ 
incisal  edges  of  the  upper  and  lower  teeth,  and 
the  scan  trajectories  of  the  root  scans. 


The  data  vectors  produced  by  the  root  scan  procedure. 
These  vectors  contain  the  densities  of  the  sanple 
points  along  the  root  scan  trajectories. 


Just  as  a  picture  has  both  a  spatial  and  frequency  domain  representation , 
so  does  a  "filter”.  While  picture  enhanoanent  can  be  acocnplished  by  filtering 


in  the  frequency  domain,  the  transformation  from  the  spatial  domain  to  the  frequency 
domain  application  of  the  frequency  domain  filter  and  then  transformation 
back  to  the  spatial  domain  is  very  time  consuming  process,  even  an  very 
fast  computers. 

An  alternative  approach  is  to  develcpe  a  suitable  filter  in  the  frequency 
domain  and  find  its  equivalent  representation  in  the  spatial  domain.  It  can 
be  shown  that  the  process  of  filtering,  or  convolution  in  the  frequency  domain 
(or  the  power  spectrum  equivalent  which  is  the  "square"  of  the  frequencies) 
can  more  easily  be  acocnplished  by  viewing  the  density  data  in  the  spatial 
domain  through  an  aperture  window  of  varying  transmission.  Such  a  "window" 
consists  of  a  set  of  weights  which  is  the  spatial  domain  equivalent  of  the 
frequency  domain  filter.  Each  data  point  (i.e.  density  at  point  x,y)  is 
replaced  by  the  result  of  the  weighted  average  of  the  given  point  and  its 
neighbors.  See  Figure  18. 

Different  seta  of  weights  will  produce  different  "filtering"  or  smoothing 
effects.  Actually,  what  is  used  is  a  "band  pass”  filter  that  will  remove 
the  low  frequency  ccxponents  that  cause  fuzziness  of  the  boundaries,  and  also 
remove  the  very  high  frequency  "noise"  that  has  the  effect  of  introducing 
"false  boundaries”  or  artifacts  into  a  picture. 

These  filters,  or  sets  of  weights  oust  be  determined  vary  carefully,  as 
to  "heavy"  a  filter  will  smooth  out  the  data  to  such  an  extant  so  as  to 
eliminate  all  boundary  indicating  and  to  "light”  a  filter  will  have  virtually 
no  effect,  or  may  even  accentuate  the  "system  noise"  by  creating  an  effect 
called  "ringing". 
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Figure  18 


Bri>tloMhip  batwMn  filtering  in  the  spatial, domain 
and  in  the  frequency f  or  power  spectrum*  domain.  The 

effect  of  convolution  in  the  power  spectrusi  domain 
can  be  more  readily  accomplished  by  multiplication  in  the 
spatial  domain  by  viewing  the  data  through  a  "data  window** 
of  varying  transmission.  This  is  accosplished  by  replacing 
each  data  point  in  the  spatial  domain  by  soma  weighted 
average  of  the  given  point  and  its  neighbors,  the  sat  of 
weights  is  tha  spatial  domain  the  the  inverse  fourier 
transform  of  the  filter  in  the  frequency  domain. 


(a)  raw  data 

(h)  filter  representation 
(c)  filtered  data 


Fixed  RMBDry  (ncn-rscursive)  and  farting  nancy  (recursive)  bend  pass 
filters  were  used  to  enhance  the  root  acans.  Examples  of  the  transfer  function 
of  these  filters  are  illustrated  in  Figure  19(a,b,c) ;  the  typer  curve  and 
middle  curve  correspond  to  a  nonr recursive  and  recursive  filter,  respectively, 
and  the  lower  curve  is  a  plot  of  the  difference  between  the  tan  filters. 

While  the  behavior  of  both  types  of  filters  were  about  the  sane  in 
the  desired  banchpass  region,  the  recursive  (fading  memory)  filter  performed 
better  outside  of  the  band-pass  region  as  evidenced  by  the  beck  of  ringing 
at  higher  and  lower  frequencies. 

These  band-pass  filters  were  used  to: 

a)  remove  the  low-frequency  components  generated  by  the 
blurred-out  images  of  structures  outside  of  the  focal 
trough  of  the  Panozex  dental  x-ray  imaging  system;  and  . 

b)  to  reject  the  high  frequency  components  corresponding  to 
film  grain,  quantum  noise  produced  by  the  intensifying 
screens,  and  small  variations  in  density  within  the  tooth 
image  itself  due  to  anatomic  and  structural  variations  of  the 
tooth  itself  (i.e.  pulp  chamber)  and  of  the  supporting  bone 
(i.e.  bone  trabeculae) . 

Application  of  these  frequency  domain  filters  require  about  5  minutes  of 
ocnputer  time  due  to  the  need  to  transform  the  raw  data  from  the  spatial 
domain  to  the  frequency  domain  and  bade  to  the  spatial  domain  after  the  filter 
was  applied.  By  calculating  the  spatial  domain  representation  of  these  filters 
and  using  the  resulting  weighting  function  directly  on  the  raw  seen  data, 
processing  time  was  zeduoad  to  about  10  seconds  per  scan! 
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Figure  20(a)  shews  the  ten  enhanced  soot  scans  platted  in  a  serial 
manner  -  note  hew  the  hills  and  valleys  oarraepend  to  the  root  contours 
of  the  original  radiograph  (refer  to  Figure  12) .  Figure  20(b)  is  a  display 
of  the  ccnputer  analysis  of  the  occluBal/indaal  surface  scan  of  the  same 
radiograph.  The  reconstruction  of  the  teeth  images  fran  the  root  scans 
and  occlusal/incisal  surface  scan  is  shown  in  Figure  20  (c) .  Thus  this 
information  (for  one  quadrant  only)  can  be  used  to  fill  in  a  dental  chart 
is  illustrated  in  Figure  20(d). 

Figure  21  is  an  isodensity  scan  of  a  panoramic  radiograph  with 
missing  teeth.  Figures  22 (a)- (d)  show  how  the  oenputer  can  detect  the 
missing  teeth  and  report  out  the  results  accordingly. 


Isodensity  plot  of  panoramic  radiograph 
with  missing  teeth  in  lower  jaw. 


See  text  for  details 
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Just  as  various  patterns  of  density  change  on  a  global  Israel  ware  used 
to  identify  the  presence  of  teeth,  an  analysis  of  the  density  patterns  within 
these  tooth  outlines  could  be  used  to  identify  the  existence  of  certain 
conditions  within  the  teeth. 

For  exanple,  Figure  23  is  an  isodensity  scan  of  a  lower  molar  tooth. 
There  is  a  small  area  of  decay  on  the  right  side  -  note  the  very  distinctive 
diange  in  the  isodensity  curves  in  this  area  as  ocnpared  to  the  left  side 
which  is  non-carious. 

The  pattern  of  a  large  area  of  decay  is  illustrated  in  Figure  24. 

In  this  hi -cuspid  tooth,  the  entire  right  side  is  destroyed  by  caries  -  again, 
note  the  significantly  different  pattern  of  this  area  as  compared  to  the 
non-carious  left  side. 

A  metallic  restoration,  which  radiographically  appears  aa 
with  a  very  distinct  boundary,  can  be  readily  identified  in  tt 
in  Figure  24.  The  sharp  boundary  is  characterized  by  a  steep 
and  consequently  the  isodensity  contours  in  the  region  of  the 
are  tightly  bunched  together.  The  clear  area  corresponding  tc 
restoration  has  a  very  uniform  appearance  on  the  radiograph  an 
has  very  few,  if  any,  different  density  levels.  The  wall-del inaatad 
area  on  the  left  aide  of  this  tooth  below  the  radio-opaque  area  of  the 
filling  is  recurrent  decay. 

From  these  three  illustrations,  it  is  evident  that  normal  tooth 
structure,  caries  and  metallic  restorations  have  characteristic  density 
patterns  that  are  not  only  visible  to  the  eye  on  a  radiograph,  but  also  have 
very  characteristic  and  distinctive  density  patterns  that  are  capable  of 
being  recognised  by  ocaputer  programs. 
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Accordingly,  the  next  step  after  identifying  the  boundaries  of  the 
teeth,  is  to  examine  the  interior  of  the  regions  defined  as  "teeth"  to 
identify  such  renditions  as  the  existence  of  metallic  (or  other  radio-opaque) 
restorations  and  caries.  Ocnputer  programs  were  developed  to  do  a  "star-scan" 
in  an  area  within  the  tooth  boundary  corresponding  to  the  crown  of  the  tooth. 
Figure  26(a)  illustrates  how  the  ocnputer  program  is  able  to  identify  the 
crcwn  of  the  lower  first  molar.  The  center  of  this  area  was  determined  and  a 
series  of  radial  scans  executed  beginning  at  the  center  and  terminating  at 
the  outer  boundary  of  crown  region.  See  Figure  26  (b) .  These  density 
vectors  contain  sufficient  information,  both  with  respect  to  density 
changes  and  position  of  these  changes  within  the  tooth,  to  identify 
radio-opaque  restorations  and  decay.  Hcwever,  the  program  to  analyze 
this  data  have  not  been  implemented. 
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V.  Results  and  Ooncluaions 

The  ability  to  scan  a  panoramic  dental  radiograph  aid  extract  sufficient 
infoanaticn  to  identify  the  presence  or  Absence  of  teeth  has  been  demonstrated, 
and  procedures  to  do  a  detail  scan  on  the  areas  of  the  radiograph  corresponding 
to  those  teeth  present  have  been  developed.  The  characteristic  density  patterns 
associated  with  normal  tooth  structure,  radio-opaque  restorations  and  decay 
have  also  been  identified.  These  procedures  and  techniques  were  demonstrated 
an  a  set  of  original  panoramic  radiographs  taken  of  actual  people. 

There  were,  however,  difficulties  encountered  in  the  successful 
application  of  the  scanning  and  evaluation  process  to  all  radiographs:  either 
the  process  would  not  work,  or  only  a  part  (i.e.  a  quadrant)  of  a  radiograph 
could  be  correctly  evaluated.  These  difficulties  were  attributable  to  essentially 
two  conditions: 

1.  The  diagnostic  quality  (i.e.  contrast  and  detail)  of  all 
radiographs  was  not  consistent  -  in  seme  instances  the  image  was 
so  poor  that  it  was  not  possible  for  a  human  evaluator  to 
"objectively"  read  the  radiograph;  and 

2.  Variations  in  head  position  and  individual  bone  structure 
resulted  in  radiographs  with  varying  degrees  of  "noise"  due 
to  the  superposition  of  only  partially  blurred-out  anatomic 
structures  on  the  tooth  images. 

In  many  cases,  more  attention  to  the  manner  in  which  the  radiographs 
were  taken  and  better  control  over  the  developing  procedure  would  have 
produced  radiographs  that  would  probably  have  been  seamed  with  greater 
reliability. 
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For  acne  others,  however,  additional  effort  la  required  to: 

1.  Develop  a  mechanism  to  dynamically  adjust  the  density  range 

to  compensate  for  the  extreme  light  or  dark  regions  encountered, 
and  to  establish  a  normalized  density  range  for  each  radiograph;  and 

2.  To  develop  filters  with  greater  sensitivity  and  discrimination 
ability  to  reject  noise  patterns  caused  by  anatomic  variation  - 
this  is  especially  true  far  the  upper  jaws  where  the  images 

of  the  maxillary  sinus,  orbits,  zygomatic  arch,  nasal  fossae 
and  hard  palate  frequently  are  superimposed  over  the  images 
of  the  upper  teeth. 

Fran  a  technological  point-of-view,  there  has  been  little  improvement 
in  the  basic  scanning  apparatus  (i.e.  scanning  CRT  and  photomultiplier  tubes) . 
However,  there  have  been  dramatic  advances  in  logic  circuit-design  and 
fabrication,  so  that  much  of  the  older  circuitry  could  now  be  replaced  with 
micro-processors  on  chips,  and  a  ndni-ccnputer  could  be  used  in  place  of 
the  1130.  This  could  result  in  a  smaller  unit  with  increased  processing 
speed  and  the  ability  to  perform  much  more  ccnplex  picture  processing 
procedures  at  a  lower  overhead. 

It  is  generally  believed  that  if  these  basic  features  recognition 
algorithms  (with  the  modifications  incorporated  as  described  above)  could 
be  implemented  on  a  system  reflecting  the  newer  oanputer  technology,  it 
would  be  possible  to  upgrade  the  syston  so  that  there  would  be  a  marked 
improvement  in  the  performance  of  the  DKCP  scanning  system  with  respect  to 
both  processing  speed  and  system  reliability. 
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